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^ ' Abstract. - We study how the presence of correlations in physical variables contributes to 

CO ' the form of probabihty distributions. We investigate a process with correlations in the variance 

CO , generated by (i) a Gaussian or (ii) a truncated Levy distribution. For both (i) and (ii), we flnd 

^T ■ that due to the correlations in the variance, the process "dynamically" generates power-law tails 

^3 ' in the distributions, whose exponents can be controlled through the way the correlations in the 

variance are introduced. For (ii), we flnd that the process can extend a truncated distribution 
0^ , beyond the truncation cutoff, which leads to a crossover between a Levy stable power law and 

0^ ■ the present "dynamically-generated" power law. We show that the process can explain the 

crossover behavior recently observed in the S&iP500 stock index. 



Many natural phenomena are described by distributions with scale-invariant behavior in 
the central part and power-law tails. To explain such a behavior the Levy process H has been 
employed in finance 0, fluid dynamics |Q, polymers Q, city growth [||, geophysical [|| and 

Q . biological Q systems. An intense activity has been developed in order to understand the origin 

of these ubiquitous power-law distributions Iq]. The Levy process, however, is characterized by 
a distribution with infinite moments and in applications this might be a problem, e.g. analysis 
of autocorrelations in time series requires a finite second moment. To address this problem, 

2 . probability distributions of the Levy type with both abrupt H and exponential cutoffs |10 

have been proposed. A second problem is that, the Levy process has been introduced for 
independent and identically distributed stochastic variables, while for some systems there is 
a clear evidence of correlations in the variance (e.g. for many important market indices pd|). 
Moreover, a crossover between a Levy stable power law and a power law with an exponent out 
of the Levy regime, was recently found in the analysis of price changes [|l2i. We investigate 
how a stochastic process with no correlations in the variables but rather in their variance can 
be introduced to account for the empirical observations of a Levy stable form of the probability 
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Fig. 1. - The dependence on time of (a) a realization of an ARCH process Xt of eq. (hi) and (b) the 
variance at of eq. (H). The ARCH process xt is defined hv a = 0.88 and b = 0.12. For these a and 
b values, al = 1 (eq. (|)). P{wt) is the TL PDF of eq. @ with a = 1.5, 7 = 0.27, and the cutoff 
length ^ = 10 (horizontal dashed line) . Large values of xt are followed by large values of at ■ Due to 
the dynamical features of the ARCH process, values of xt can exceed the truncation cutoff £ of the 
TL distribution, and the regime beyond the cutoff length becomes populated [see fig. 3]. 



distribution in the central part and a crossover to a power-law behavior different than the Levy 
in the far tails. 

In finance, a stochastic process with autoregressive conditional heteroskedasticity (ARCH) 
[Ol is often used to explain systems characterized by correlations in the variance. The ARCH 
process is a discrete time process Xt whose variance a^ depends conditionally on the past 
values of Xt- The ARCH process is specified by the form of the probability density function 
(PDF) P{wt) of the process Wt which generates the random variable Xt- 

Here we ask to what extent the presence of correlations in the variance cr| contributes to 
the form of the probability distribution P{zn), where z„ = J^lZ" xt+i-i and xt is the ARCH 
process (in finance Zn is called temporal aggregation of the ARCH process xt). We perform 
numerical simulations and investigate the form of P(zn), when the PDF P{'Wt) of the process wt 
which generates xt is either of two cases, (i) a Gaussian, or (ii) a truncated Levy distribution. 
For case (i) and n — 1 (i.e. zi = Xt), the ARCH process generates P{xt) which, to a good 
approximation, can be fit at the tails by a single power law ||lj|. For case (ii) and n = 1, we 
show that the interplay between the Levy form of the distribution in the central part and the 
dynamics of the ARCH process can give rise to a crossover between two power-law regimes in 
the tails of P{xt). For both (i) and (ii), at large n, we find clear convergence of P{zn) to a 
Gaussian |15|| . 

Suppose Xt is generated by an independent and identically distributed (i.i.d.) stochastic 
process wt, drawn from a PDF P{wt) with zero mean (< wt >= 0) and unit variance 
(< w^ >= 1), 



Xt = CTtWf 

Then xt follows an ARCH process if the variance cr^ evolves in time as 



(1) 



a? = a + b X 



2 



(2) 
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Fig. 2. - Log-log plot of P{z„) for the temporal aggregation z„ of the ARCH process xt calculated for 
different time scales n =l(o), 10(Q), and lOO(o). The ARCH process xt with a = 0.49 and b = 0.51 
has the expected variance a^ — 1 (eq. 0) and kurtosis k^ — 10 (eq. 0) . Wt in eq. (nl) is chosen from a 
Gaussian distribution (k„ = 3). Due to the correlations in the variance af , the temporal aggregation 
of the ARCH process generates power-law tails in P(z„) for small time scales n. By solid lines, for 
the same time scales {n — 1, 10, and 100), we denote the Gaussian process with the same variance 
as the ARCH process. In the inset, we show a log-log plot of the probability of return to the origin 
P{zn — 0) for the same ARCH (o) and for the Gaussian process (solid line); the line has slope 0.5 
— the value predicted for the Gaussian — which suggests that P{zn) gradually tends towards the 
Gaussian with increasing n. 



where a and b are two non-negative constants ||l^. For b = 0, the ARCH process xt reduces 
to the i.i.d. stochastic process wt — no correlations in all moments. For b j^ 0, the stochastic 
process Xt is uncorrelated — < XtXf >^ dtf — but has correlations in the variance a^. Indeed, 
the ARCH process is characterized by exponentially-decaying correlations in the variance 
< (jf<Tf, >^ exp{— (i' — t)/T} with decay constant r = \log{b)\~^. 

In fig. 1 we see that a^ is large when x^_i is large. The ARCH process is specified by the 
functional form of the PDF P{wt) which controls the stochastic variable Wt and also by the 
value of the parameter b (eqs. ^ and ||). In the ARCH process i-'(wt) is traditionally the 
Gaussian, but other choices are possible [l6| . Furthermore, the correlations in the variance 
af can be controlled by changing the parameter b — larger values of b relate to stronger 
correlations. 

E< X? >=< a? > |0. From this relation 



The expected variance of xt is a constant: ct^ 
and eqs. (Q) and (g) follows 



(3) 



and 



<x'' > 

(< a;2 >)2 



1 — l^inb^ 



(4) 



where k^j is the kurtosis of P{'Wt), a common measure of the degree of "fatness" of the 
distribution related to the fourth moment |1^, nSl. From eq. (0), cr^ is finite if 6 < 1, while 
finiteness of kurtosis k^ (and the fourth moment of Xt) requires Kwb^ < 1. No matter what 
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Fig. 3. - Linear-log plot of the PDFs of (o) the truncated Levy process Wt without correlations and 
(•) the ARCH process xt (n = 1), where wt of eq. (nh has the TL distribution of eq. (fel) with a = 1.2, 
7 = 0.21, and cutoff length 1 = 9 (vertical dotted lines), implying «:„, — 24.2. Parameters of the 
ARCH process are a — 0.9 and b — 0.1 giving Kx = 31.6 (eq. m. While the central part (o) of the PDF 
remains practically the same for both wt and Xt processes, the ARCH process xt extends the range 
of the TL to Xt > £ due to the correlations in the variance at (eq. bl). This ARCH-extended regime 
(•) is rarely populated and therefore decays faster. In the inset, we show log- log plot of the PDF of 
the ARCH process Xt- The process leads to extension of the range of the original TL distribution, 
with a crossover between two different power-law regimes: the original Levy stable power law and the 
dynamically-generated power law (appearing beyond the truncation cutoff I). The exponent of the 
power law in the ARCH-extended regime is defined by correlations in the variance at through the 
parameter b (eq. bh. 



functional form for P{wt) we choose, the ARCH process generates PDFs with slower decaying 
tails compared to P{wt) — Kx > Hw from eq. (p. Such a slow decay in the tails of P{zn) for the 
ARCH process may come both from the choice of the P{wt) and the presence of correlations 
in the variance, i.e. Kw and b respectively. 

First, we consider the temporal aggregation z„ of an ARCH process for a particular choice 
of P{wt) given by a Gaussian distribution (see fig. 2). Due to the correlations in the variance 
(eq. (^)), the ARCH process, for small n, generates tails which can be approximated by a 
power law. Given that the parameter b controls the correlations in the variance cr|, we find 
that the slope of this power law is directly linked to these correlations — the stronger the 
correlations in cr^, the smaller the slope of the power-law tail. For large n, the PDF of the 
temporal aggregation z„ of the ARCH process resembles the form of the Gaussian distribution, 
i.e. P{zn) tends to the Gaussian, with a variance of na^- 

Second, we analyze the ARCH process where P{wt) (eq. (|^)) is the truncated Levy (TL) 
distribution B, defined by 



Ta,'y,liw) = 



NCc,^{w) \w\ < I 
' \w\>l 



(5) 



Here, Ca.-^iw) is the symmetrical Levy stable distribution R, 0], a is the scale index (0 < a < 
2), 7 is the scale factor (7 > 0), A/" is the normalizing constant and £ is the cutoff length. 
Note, that the TL distribution is characterized by power-law tails from zero up to the cutoff 
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Fig. 4. - PDF of the 1 rnin price changes for the S&iP500 stock index over the 12-year period Jan 
'84-Dec '95. The central part of the empirical PDF is well fit with the Levy distribution {a = 1.4) up 
to the cutoff length £ (arrow), followed by crossover to a second "dynamically-generated by ARCH" 
regime {xt > £), which can be approximated by a power law with slope 4.4 (a = 3.4). We show 
a realization of the ARCH process, where P{wt) is the TL distribution of eq. (y) with a — 1.4, 
7 = 0.275, length £ = 8, and the process is characterized by fe = 0.4, where a is chosen to give the 
empirical standard deviation a = 0.07. Note that the bump at the truncation cutoff £ in the PDF of 
the ARCH process in fig. 3 is more pronounced compared to the bump in the PDF of the S&P500 
data and the ARCH process in fig. 4. This is due to the fact that the correlations in the variance at 
introduced for the particular realization of the ARCH process in fig. 3 are weaker (b = 0.1) compared 
to the correlations in the S'&P500 data (6 — 0.4). 



length £. In performing numerical simulations ^^ , we employ an algorithm of Rcf. ||l3 . 

In fig. 3, we show the PDF of an ARCH process Xt {n — 1) where P{wt) is the TL 
distribution. We find two regimes where the values of Xt are smaller and larger than the 
cutoff length £ of P{wt)- The first regime {xt < i) is characterized by the Levy power law 
due to the choice of the P(wt) (eq. ^. Due to the correlations in the variance a^ (eq. g), the 
ARCH process extends the range of the PDF to xt > £, generating a new power law different 
from the Levy power law in the first regime. This second regime, where Xt > t, is rarely 
populated — events in that regime occur only when two large values of Xt follow each other. 
Since such events have small probability, the PDF of the ARCH process Xt in that regime 
decreases faster compared with the first regime where the fluctuations of xt are smaller than 
the cutoff length £. 

The existence of two regimes in the PDF, characterized by two different power laws, is 
empirically observed in high-frequency data on price changes p2| . In addition the central part 
of the empirical PDF in financial data is well described by a Levy distribution and exhibits the 
same scale- invariant behavior B] . Such behavior of the empirical PDF can be mimicked by the 
ARCH process with a TL distribution, since the ARCH process generates power laws in the 
far tails while preserving the form of the PDF in the central region (figs. 2 and 3). Empirical 
data also show a bump in the PDF of the price changes calculated for a delay of 1 min. A 
similar bump is observed in fig. 3 for the ARCH process Xt around the cutoff length £. We find 
that this bump is a signal for changing the power-law exponent in the probability distribution. 
In fig. 4 we show the PDF of the ARCH process in good agreement with the PDF of 1 min 



EUROPHYSICS LETTERS 



10" 



^ 10" 
o 
II 

N 

Q. 



10"' 







\. X-, 


LEVY 




GAUSSIAN 


^v^ 


ARCH with TL 




^^\ 0.5 




N \^ 






1^ ^^^ 






N 

■s 


k^ 




S 




0.67 



10" 



10' 



10 10 

n 



N 
D. 



10" 



10"' 



10"^ 



10"^ 



- GAUSSIAN 
■ n=1 ARCH 
n n=10 ARCH 
" n=100 ARCH 




-60 -30 



30 60 



1 (eq. 0) and kurtosis Kx — 31.4 
T,^, = 1 and K„ = 21.9 (eq. 0)) 



Fig. 5. - (Left panel) Log-log plot of the probability of return P{zn = 0). where z„ is the temporal 
aggregation of the ARCH process with a = 0.88, b = 0.12, a^ — 
(eq. m. P{wt) is the truncated Levy distribution (eq. h) (with 
obtained by setting a = 1.5, 7 = 0.27, and £ = 10. Also shown is the Levy stable process wTth 
Q — 1.5 (slope equals 1/a) and 7 — 0.27, and the Gaussian process with variance a^ = 1 equal to 
the expected variance a^ of the ARCH process. For small values of n, Zn follows the Levy process 
and then converges to the Gaussian. (Right panel) Linear-log plot of P{zn) calculated for different 
time scales n. For the same time scales, we also show the Gaussian process to which z„ gradually 
converges. Parameters for both Gaussian and ARCH process are defined as for the left panel. 



price changes for the 5&P 500 index. The central part {xt < i) of the PDF characterized 
by Levy-stable power law with slope 2.4 {a — 1.4) is followed by a crossover to a second 
"dynamically-generated" by ARCH regime {xt > i) with a different behavior, approximately 
power law with slope 4.4 {a = 3.4). As in the case of the ARCH process with Gaussian PDF, 
we can control the exponent of the power law in the second dynamically-generated by ARCH 
regime by tuning b, while the parameter a is chosen to give the empirical standard deviation. 

Next we study the asymptotic behavior (at large time scales n) of the PDF of the temporal 
aggregation z„, where P{wt) is the TL distribution. In fig. 5 we show P{zn — 0) for 
the ARCH process. For small n, P{zn — 0) approximately follows the Levy distribution 
Ca,'y{zn = 0) = r(l/a)/ [7ra(n 7)^^"] with the same a and 7 as P(wt). For n > 30, P{zn = 0) 
tends to a Gaussian distribution G(z„ = 0) = l/lV^Tvaxn^^"^] with variance ax defined by 
eq. (||) and equal to the variance of P{xt) ||l^. Thus, despite the presence of correlations 
in the variance a^, the temporal aggregation Zn of the ARCH process behaves like an i.i.d. 
process, characterized by a fast transition from Levy to Gaussian process ( "ultra- fast" TL 
flight d]). Since the correlations in the variance are of short range, for sufficiently large time 
scales n, P{zn) approaches a Gaussian form, a behavior normally associated with uncorrelated 
stochastic variables (fig. 5). 

In summary, we find that power-law tails in distributions can be dynamically generated 
by introducing correlations in the variance of stochastic variables, even when the initial 
distribution of these variables is the Gaussian. We also find that when the initial distribution 
is a truncated Levy distribution, the process of introducing correlations in the variance can 
extend the range of the PDF beyond the truncation cutoff. This extension of the range of the 
original probability distribution is characterized by a crossover between two different power 
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law regimes: the original Levy stable power law (within the limits of the truncation cutoff) and 
the "dynamically-generated" power law (beyond the truncation cutoff). This behavior appears 
to explain the empirically-observed crossover in the PDF of price changes for the S'&P500, and 
carries information about the relevant parameters of the underlying stochastic process. Our 
findings can help understand to what extent the presence of correlations in physical variables 
contributes to the form of probability distributions, and what class of stochastic processes 
could be responsible for the emergence of power-law behavior. 

We thank Jan W. Kantelhardt and Kaushik Matia for helpful discussions, and NIH/National 
Center for Research Resources (P41 RR13622) for financial support. 
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